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Abstract 

Random Overlap Structures (ROSt's) are random elements on the space of proba- 
bility measures on the unit ball of a Hilbert space, where two measures are identified 
if they differ by an isometry. In spin glasses, they arise as natural limits of Gibbs mea- 
sures under the appropriate algebra of functions. We prove that the so called 'cavity 
mapping' on the space of ROSt's is continuous, leading to a proof of the stochastic sta- 
bility conjecture for the limiting Gibbs measures of a large class of spin glass models. 
Similar arguments yield the proofs of a number of other properties of ROSt's that may 
be useful in future attempts at proving the ultrametricity conjecture. Lastly, assum- 
ing that the ultrametricity conjecture holds, the setup yields a constructive proof of 
the Parisi formula for the free energy of the Sherrington-Kirkpatrick model by making 
rigorous a heuristic of Aizenman, Sims and Starr. 



1 Introduction 

This paper develops some connections between random probability measures on Hilbert 
spaces and the Gibbs measures of spin glasses with Gaussian disorder. Consider for A" G N 
random processes of the form 

H N :=(H N (a),ae{-l,+l} N ) , 
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where H^(a) is a centered Gaussian variable. Denote the law of by P and the cor- 
responding expectation by E. Suppose that the covariances between variables are of the 
form 

E H N (a)H N (a') = Nr(a,a') 

for some positive definite symmetric form r on {—1,-1-1}^ with r(cr, a) = 1 for all a. We 
say that is the Hamiltonian of a Gaussian spin glass. An important example is the 
Sherrington-Kirkpatrick (SK) model for which 



r(a, a') 




The definition also includes the Edwards- Anderson (EA) model. This model can be defined 
for example in a box of Z d with N vertices and edge set S^. The form for the EA model is 
then 



r(a, a') = y=—r ^2 ViV-> <J ; <J 



N 



J 



The Gibbs measure corresponding to the Hamiltonian Hn at inverse temperature (3 is defined 
by 

exp f3H N (a) 

GpA°) = Zn{p) (1-1) 

where Z N ((3) = J2 a ex P 0H N {a). A fundamental problem in the theory of spin glasses is to 
describe the limits of Gp,N as N tends to infinity. This information is useful in particular 
to understand the extreme value statistics of the Gaussian process H^. In the past ten 
years, the rigorous study of spin glasses has made important progresses in the understanding 
of the models in the limit iV — > oo. One of the major achievements was the proof of 
the Parisi formula by Guerra and Talagrand [T5l [30] for the limiting free energy (that is, 
lim7v-s>oo jjE log Z N ((3)) of the SK model. The formula suggests that the limiting Gibbs 
measure Qp of the SK model (in a suitable sense) has a support that is hierarchical or 
ultrametric, that is with P-probability one 

gf{(a,a',a") : r(a, a') > min{r(a,a"),r(a',a")} } = 1 . 

In fact, it is expected that the ultrametricity of the Gibbs measure is universal to a certain 
extent within spin glasses. This hypothesis is at the core of the description of spin glasses 
developed by physicists, and often referred to as Parisi theory [19]. In spite of important 
advances in the understanding of the structure of the Gibbs measure [231 E] j the problem of 
rigorously characterizing the limiting Gibbs measures of spin glasses remains open. 

This paper takes the approach introduced by Aizenman, Sims and Starr [3] and extended 
in [7] to study the limiting Gibbs measures of spin glasses. The idea goes as follows. Given 
an infinite-dimensional separable Hilbert space H with inner product there exists an 
embedding of the hypercube { — 1, 1}^ in H that preserves the form r, that is, if cr i — > v(a) E 
% then 

r(<j, cr') = v(a) ■ v(a') . 
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For example, for the SK model with N sites, the Hilbert space H can be taken to be the L 2 
space of some abstract probability space J 7 , P), and the map v defined as 



where gij : — > R are independent standard Gaussian random variables under P. 

Under such an embedding, the Gibbs measure is naturally sent to the random probability 
measure on % assigning weight Gp,n(o) to the corresponding vector v (a). Of course, there 
is more than one such isometric embedding. Since the products v ■ v' determine the vectors 
up to a choice of basis for H, it is necessary to identify the probability measures on H that 
differ by an isometry for the image measure of Gp,N to be well-defined. It turns out that the 
proper way to study such measures is through the notion of a Random Overlap Structure 
or ROSt. A ROSt is a N x N random covariance matrix whose law is invariant under 
simultaneous finite permutations of rows and columns. In the spin glass setting, the ROSt is 
the matrix Q@' N = {r(o~ k , o~ l )}k,ien where (<r fc , fceN) are sampled independently from Qp t N- 
The space of ROSt's is compact in the appropriate topology and it is in correspondence, up 
to isometry, with the space of random probability measures on Ti (see Section |TTT|) . Thus 
one way to study the limiting Gibbs measures of spin glasses is to describe the limit points 
of the sequence (Q 13 ' 1 ^) in the space of ROSt's. (Another promising approach is through the 
Ghirlanda-Guerra (GG) identities [HI [231 l3Tj . Although the GG identity approach is not 
the focus of this article, it seems to be closely connected to the ROSt approach at some 
level.) 

The main result of this paper is to establish that the limiting Gibbs measures (in the 
ROSt sense) of any Gaussian spin glass as defined above is stochastically stable. What this 
means is that the ROSt's for Gaussian spin glasses are distributionally invariant under a 
built-in stochastic mapping that we call the cavity mapping. (The mapping is well-known, 
but the nomenclature is ours. Precise definition is given below.) The transformation derives 
its name and structure from the cavity method introduced in [2Uj (see also [UJ for the 
definition of the mapping for Ruelle Probability Cascades). It has the features of a basic 
stochastic object akin to the mappings studied by Kahane in the context of multiplicative 
chaos [18] . Similar mappings have been considered earlier in the setting of competing particle 
systems (see e.g. [2"gj 15]). 

It was suggested by the work of several authors that the Gibbs measures of spin glasses 
must be stochastically stable [21 [31 [281 M- Such a statement, however, can be made pre- 
cise only in the infinite-dimensional setting. One missing ingredient to make the assertion 
rigorous at the level of ROSt's was a proof of the continuity of the cavity mapping. This 
is done in Theorem 11.41 Combining this with some further ingredients, it follows that the 
limiting Gibbs measure of a Gaussian spin glass is stochastically stable at any where the 
free energy is differentiable (by convexity, this holds for almost all 0). 

The characterization of stochastically stable ROSt's is a challenging problem. In view of 
the main result of this paper, it is also a rewarding one since it provides a way to establish 
universal properties of the Gibbs measures of spin glasses, in particular the alleged ultra- 
metricity. We formulate below a precise conjecture, which may be called the Ultrametricity 
Conjecture for ROSt's: a ROSt that is stochastically stable (in a strong sense to be defined) 
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must have ultrametric support. Some partial results towards the resolution of this conjecture 
are given in Section HJ The most important one might be Theorem 1 1 . 71 which states that the 
support of a stochastically stable ROSt is either one vector or lies in an infinite-dimensional 
subspace almost surely. 

The framework of ROSt's has other interesting consequences for spin glasses. In partic- 
ular, assuming that the ultrametricity conjecture for ROSt's is true, we give a constructive 
proof of the Parisi formula for the free energy of the Sherrington-Kirkpatrick model. This 
makes rigorous the approach suggested by Aizenman, Sims and Starr [3J to prove the Parisi 
formula. 

We remark that results similar to ours have been proved in parallel by Panchenko [26J. 
The work focuses on mean-field spin glass models where the law of the Hamiltonian is 
invariant under permutation of spins, such as the SK model. In this case, a representation 
theorem for exchangeable arrays (the Aldous-Hoover theorem) can be used. In the ROSt 
setting, we appeal to the Dovbysh-Sudakov theorem (Theorem 11.21 below). A continuity 
result is proved and a representation for the Parisi formula, similar to the one obtained here 
for ROSt's, is found 

The paper is organized as follows. The framework of ROSt's as well as the precise 
statements of the main results are given in Section 11.11 The applications of the framework 
to spin glasses are presented in Section [L2l The continuity of the cavity mapping is proved in 
Section [2j Section [3] derives the Parisi formula from the Ultrametricity Conjecture. Finally, 
some interesting properties of stochastically stable ROSt's are proved in Section HJ 

Acknowledgments. We thank the referee for insightful remarks and observations that 
led to major improvements of the first version of this paper. 

1.1 Random Overlap Structures and Probability Measures on Hilbert 
Spaces 

This section begins with the definition of random overlap structures using exchangeable 
covariance matrices. The definition is then explained in terms of probability measures on 
Hilbert spaces using the representation theorem of Dovbysh and Sudakov [TJ]. This setup 
was previously described in [7]. The section ends with the definition of the cavity mapping 
and the statement of several related results. 

Consider the space of positive semi-definite symmetric N x N matrices, or covariance 
matrices, with 1 on the diagonal. This is a compact separable metric space when considered 
as a closed subset of [—1, l] NxN equipped with the product topology. The Borel probability 
measures on this space form also a compact, separable and metric space when equipped with 
the weak-* topology generated by the continuous functions on the entries. An element P of 
this space is the law of some random covariance matrix Q = {%•}. The continuous functionals 
in the topology considered can be approximated by linear combinations of monomials of the 
form 

P^E J] q\f , (1.2) 

l<i<j<s 

for s G N and a collection ku 6 N. A random covariance matrix Q is said to be weakly 
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exchangeable if for any permutation matrix r that fixes all but a finite number of elements 



„ _x law „ 
r Q r = Q , 

where denotes equality in law. Since this symmetry is preserved under convergence 
defined by the functions (11.21) . the space of distributions of weakly exchangeable random 
covariance matrices with 1 on the diagonal is a compact convex set. Throughout the paper, 
we refer to this subset of laws as the space of ROSt's. 

Definition 1.1. A random overlap structure, or ROSt, is a weakly exchangeable N x N 
random covariance matrix with 1 on the diagonal. The law of a ROSt will be usually denoted 
by P and integration with respect to ¥ by E. 

Since the law of a ROSt is determined by the countable set of functions of the form (11. 2p . 
it is convenient to see these as the coordinates of the ROSt. 

The relation between ROSt's and probability measures on Hilbert spaces is provided by 
the representation theorem of Dovbysh and Sudakov [H] (see [25j for a readable proof of this 
result). Let B be the unit ball of an infinite-dimensional separable Hilbert space % (fixed 
throughout this paper). The inner product on TL will be denoted by • and a generic element 
of B by v. The set of Borel probability measures on B is denoted by Ai{B). Note that M.{B) 
is the same whether B is equipped with the weak topology or the norm topology. From any 
element of A4(B), one can construct a ROSt by taking iid vectors sampled from this element 
and considering the Gram matrix of these vectors. The Dovbysh- Sudakov theorem states 
that any weakly exchangeable random covariance matrix can be constructed this way if one 
considers random elements of Ai(B). In the case where the diagonal entries of the matrices 
are all 1, the Dovbysh-Sudakov theorem reads: 

Theorem 1.2. Let Q = {%} be a ROSt. There exists a random element fi of Ai(B) such 
that conditionally on fi, 

where (v\i G N) are iid fi- distributed vectors in B. 

We refer to the measure \x as the sampling measure of the ROSt Q in this article. It plays 
a role analogous to the empirical measure in de Finetti's theorem. The law of Q does not 
determine the sampling measure uniquely. However, there is a one-to-one correspondence 
between ROSt's and random elements of M.(B) if the elements of Ai(B) that differ by an 
isometry are identified. The reader is referred to [25J for a proof. 

Proposition 1.3. Let Q and Q' be two ROSt's with sampling measures \x and // . Then 
Q Q' if and only if there an isometry T of B (possibly dependent on the realization of fi) 
such that n(A) n'(T~ l A) for any A C B Borel measurable. 

We write v = (f 1 , v s ) for an element of B s and /j,® s for the product measure of s 
copies of fi. Here s is an arbitrary positive integer. Each sampled vector is called a replica. 
Throughout the paper, expectation of a function F : B s — > K. with respect to /i® s will often 
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be written fi® s (F) for short. In this notation, the continuous functionals f ll.2j) for ROSt's 
are all of the form 

P m- E [// 0S (F(v))] . (1.3) 

where F : i3 s — > K. is a continuous function on s replicas, that is, a continuous function that 
depends only on the inner product between s distinct vectors: 

F(v) = F(v k -v l ;l <k<l<s). 

The central topic of interest in this article is a class of ROSt's that possess an invariance 
property called stochastic stability. This is defined as follows. 

Let P be a ROSt. Let Pi be the law of a collection of independent standard Gaussian 
random variables (Zj, i G N), defined on the same probability space as P and independent of 
it. Let Ei denote integration with respect to Pj. For each v G B, we consider the Gaussian 
random variable l{v) = ^2 ie ^h v ■ e«, where (e,, z G N) is a fixed orthonormal basis of H. 
The covariance of /(f) and l(v') is given by 

E l [l(v)l(v')] = vv' . 

The Gaussian process Z = (l(v ), u G B) indexed by B is called the cavity field in this article. 

Note that the function v (-)■ l(v) = J2ien h v ■ e^ oia B is measurable Pj-aJmost surely being 
the pointwise limit of weakly continuous functions. Moreover, because KEi [//(Z(t>) 2 )] < 1 by 
Fubini's theorem, for any law of ROSt P there exists a set of realizations of Z of P/-probability 
one such that l(v) is well-defined for //-almost all v and for P- almost all //. 

We now define the cavity mapping from the space of ROSt's to itself. The mapping is 
defined on the sampling measure. Let A > be a parameter, P be the law of a ROSt with 
sampling measure //, and Z be a cavity field independent of P, we take: 

^(eAK^-^IMP) 

The image ROSt is constructed using $a,jA* as sampling measure. Its law is induced by 

P x Pi. We stress that the factor e^"""" 2 is the expectation of e xl<yV \ and its presence turns 
out to be crucial for the continuity of the mapping. The cavity mapping can also be defined 
in terms of the continuous functions (11.31) since they determine the law of the ROSt: 



E[^ s (F(v))] ^ E[($ x ^)® s (F(v))] = EEi 



^® s ( y F(v)e xl(vl) -^ vln \..e xl{vS) -^ vS \ 1 ^ 
^ S ( e A^i)-4iK|p_ e A^)-4lMI 2x 



It will be a consequence of Theorem 11.41 that the cavity mapping is well-defined, that is, 
the image ROSt is the same if we apply (jl.4p to two random elements of M.(B) that are 
sampling measures of the same ROSt. 

We remark that this mapping can be generalized in at least two ways. First, for any func- 
tion ip G C 1 (1R) with bounded derivative, we can take the change of density E z [e^^+^V 1- ^'!! 2 )^ 
where z is a standard Gaussian with expectation E z . Second, one could consider the cavity 
field l c with Ei[l c (v)l c (v')] = c(v ■ v') for some continuous function c satisfying 

c(l) = 1 (v, v') !->■ c(v ■ v') is positive definite . (1.5) 
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We will often write l p corresponding to the choice c(v-v') = (v-v') p for p e NU{0}. Equation 
(jl.4j) is the particular case if>(x) = Xx and c(x) = x. The generalized mapping takes the 
form 

3\w :u4$i|/i:=— J ^ v — -. (1.6) 

* M ^ ^.[e^M+'V^iMi 5 ))]) 

The first result of this paper, from which all others essentially stem, is proved in Section 

El 

Theorem 1.4. The mapping from the space of ROSt's to itself defined by fll.6p is continuous. 

We are interested in ROSt's whose law is invariant under the cavity mapping (11. 6p . This 
is equivalent to say by Proposition 11.31 that the sampling measure \i has the same law as 
$^ z c /i, up to an isometry of B. One direct consequence of the continuity is that the set of 
invariant laws under a family of cavity mappings is compact in the space of laws of ROSt's 
(see Corollary 14. ip . a simple fact that will turn out to be useful, for example in the proof of 
the Parisi formula (see Corollary 13. 7p . Our focus is on ROSt's whose law is invariant under 
the cavity mapping for linear functions ip. 

Definition 1.5. A ROSt of law P is called stochastically stable if, for any A > 0, its law is 
invariant under the cavity mapping (jl.4j) . In other words, for any s6N and any continuous 
function F on s replicas 

E^ s (F(v))} = E[(<f> x>l ri® s (F(v))] . 

It is called stochastically stable for the cavity field l c if the above holds with I replaced by the 
cavity field l c with covariance Ei[l c {v)l c {v')] = c(v ■ v'). 

As we shall explain in the next section, continuity provides the missing link between 
the stochastic stability as defined here and stochastic stability of the Gibbs measure of 
spin glasses as studied in [21 [131 EE]- This link provides a statement of the ultrametricity 
conjecture on the characterization of stochastically stable ROSt's. 

Conjecture 1 (Ultrametricity Conjecture). If a ROSt of law P is stochastically stable for 
the cavity fields l p (defined below (jl.fip ) for p = 1 and infinitely many p, then the support of 
its sampling measure \x is ultrametric F-a.s., that is: 

v • v' > min {v ■ v", v' ■ v"} for [j,® 3 -almost all v, v', v". 

Moreover, the law of the sampling measure is a convex combination of Ruelle Probability 
Cascades. 

Ruelle Probability Cascades (RPC's) form a compact subset of ROSt's parametrized by 
the right-continuous, increasing functions on [0, 1] with values at and 1 at 1 (we refer 
to [7] for a proof of the compactness). They have ultrametric support and they are known 
to be stochastically stable for any cavity field l p , p € N. We shall not need their precise 
definition here. The reader is referred to [271 EU E] f° r more details. It is very likely that 
the hypotheses of the conjecture can be relaxed. However, it does not hold if stochastic 
stability for a single cavity field is assumed. A simple counterexample is given at the end 
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of Section HJ The conjecture was proved in the case where the support of /z 02 is finite in 
[S] (see also [2T] for an extension of that proof). In this case, \i is supported on countable 
vectors and the conjecture can be formulated in the language of competing particle systems. 
A similar statement of the ultrametricity conjecture exists where the assumption of stability 
is replaced with the extended Ghirlanda-Guerra identities: 

Definition 1.6. A ROSt with sampling measure \x is said to satisfy the Ghirlanda-Guerra 
(GG) Identities if for any s G N and any continuous function F on s replicas we have 

E[/j® s+l (v l -v s+l F(v))) 

1 1 s 

= -Elfi^iv 1 ■ v 2 )] E[fi® s {F{v))] + H^iv 1 ■ v l F{v))] . 

S S 1=2 

It is said to satisfy the extended Ghirlanda-Guerra identities if the above holds when the 
products v l ■ vi in the expectations is replaced by (v l ■ v^) p for any peN. 

A version of the ultrametricity conjecture assuming finiteness of the support of the overlap 
distribution and the extended Ghirlanda-Guerra identities was proved by Panchenko in the 
case where n® 2 has finite support [23]. (The assumptions are slightly different from the 
ones used in the proof of the conjecture using stochastic stability in [5] where stability for 
infinitely many p's in N, but not all p, is needed. However, it is possible that the two sets 
of hypotheses are equivalent in the special case where the support is finite.) We also stress 
that ultrametricity has been proved for generalized versions of GREM spin glass models by 
Bolthausen and Kistler [9j [10] . 

The continuity of the cavity mapping has interesting consequences that we discuss in 
Section HJ For one, it provides an ergodic decomposition of stochastically stable ROSt's. 
The Ultrametricity Conjecture can then be restated by saying that the extremes of the 
considered set of stochastically stable ROSt's are exactly the RPC's. The decomposition is 
useful to prove properties of the support of the sampling measure. We stress that invariance 
under a single cavity mapping is sufficient here. 

Theorem 1.7. Let P be the law of a ROSt that is invariant under the cavity mapping 
for a given A > 0. Let \x be its sampling measure. Then fi is supported on a single vector or 
on an infinite- dimensional subset of B. 

If invariance under more fields is assumed, we can prove more. 

Theorem 1.8. Let P be the law of a ROSt that is invariant under the cavity mapping $\ t i p 
for a given A > and for infinitely many pGN. Let \x be its sampling measure and suppose 
that /x 02 {(v,f') G B 2 : \v ■ v'\ = r^ iax (/i)} > on a set of positive ¥ -probability, where 
?"maxGu) = sup{0 < t < 1 : fi{\\v\\ > r} > 0}. Then, 

fi{v G B : |H| = r max (^)} = 1 F-a.s. 

In other words, /i is almost surely supported on a sphere. 

This last property does not hold in general if stability is assumed for a single cavity field. 
A counter-example is given in Section HI 
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Properties of the sampling measure for ROSt's satisfying the extended Ghirlanda-Guerra 
identities have been obtained in [23] • The apparent similarities of the properties of the ROSt's 
satisfying the Ghirlanda-Guerra identities and stochastic stability motivate the following 
question: are the Ghirlanda-Guerra identities and stochastic stability two representations 
of the same property ? Since the set of stochastic stable ROSt's is closed under convex 
combinations and not the set of ROSt's satisfying GG, we conjecture the following: 

Conjecture 2. The laws of the ROSt's satisfying the Ghirlanda-Guerra identities correspond 
to the extremes of the convex set of laws of the stochastically stable ROSt's. 



1.2 Application to Spin Glasses 

Consider a Gaussian spin glass Hamiltonian and its Gibbs measures Gp,N at (3 as defined 
in the introduction. It is straightforward to construct a ROSt Q^' N from Gp,N by taking 

Q^ N = {r(a\^) } tjm 

where (V) ig N are elements of {—1,-1-1}^ sampled iid from Gp,N- Here the form "r" is the 
one of the given spin glass model, but the same construction holds for any positive definite 
symmetric form on {—1, +1}^. Note that the randomness of Q^' N comes from the sampling 
and the randomness of Gp,N itself. 

The considerations of the previous sections ensure that the random matrix Q^ ,N can be 
constructed from a random sampling measure /x/3,at on B. In particular, for any function F 
on s replicas there is the identity 

E Sp,%( F ( r ( a ^ 1 < * < * < s)) = E ^ N (F(v k ■ v l - 1 < k < I < s)) . (1.7) 

The sequence (Q^' N ) in the space of ROSt's has limit points, since the space is compact. 
These limits should retain in some ways the Gibbsian nature of Gp,N- Two properties of 
the limit points seem to be of importance: the Ghirlanda-Guerra identities as presented 
earlier and the stochastic stability for the sequence of sampling measure (/x^.at). Stochastic 
stability for the sequence defined below does not directly translate into stochastic stability 
as presented earlier of the limit ROSt. As we shall see, Theorem 11.41 fills this gap. 

Stochastic stability was first introduced in [2J and originally defined as follows. Let (Gp,n) 
be a sequence of Gibbs measures at inverse temperature (3. Consider similarly as before the 
Gaussian field (1(c) : o G { — 1,-t-l}^) independent of H N , whose law we again denote by 
Ei, with covariance Ei[l(o~)l(a')] = r(o~,a'). For some A > 0, we consider the mapping (ll.4p . 
Since here ||er|| = 1 for any vector in the support, it reduces to 

It is readily checked by property of Gaussians that the image in (jl.8p has the same law as 
the Gibbs measure at temperature \/ /3 2 + X 2 /N. The original idea of [2J is that a continuous 
dependence on (3 of the Gibbs measure is equivalent in the limit iV — > oo to stability of the 
measure under the mapping (11. 81) . 
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Definition 1.9. A sequence of Gibbs measures (Gn) is said to be stochastically stable if for 
any A > ; s G N and for any continuous function F on s replicas, 



lim 

AT-s-oo 



EE, 



G% s {F{<r)e 



A/(cr 1 ) e A«(<r s )N 



- Egf(F(a)) 







gf(e xl ^)...e xl ^ s )) 

where F(cr) stands for F(r(o- l ,cr k ); 1 < k < I < s). 

It was shown in [13] that stochastic stability in the sense of Definition 11.91 holds on 
average over (3. An improvement was made in [31] where it is proved that for any (3 and 
sequence of Gibbs measures {Gp,n) there exists a sequence 0n — > {3 such that the sequence 
(Gp n ,n) is stochastically stable. We show here that stochastic stability holds at any j3 where 
lini7v-s>oo jjE log Zn(/3) is differentiable. This is an analogue of an elegant result of Panchenko 
[23] which proves the validity of the Ghirlanda-Guerra identities under the same hypothesis. 

Proposition 1.10. //lim7v-s>oo jjE log Z N ((3) exists and is differentiable at (3 > 0, then the 
sequence of Gibbs measures (G/3,n) is stochastically stable in the sense of Definition \1.9[ 

Proof. Let F be a continuous function on s replicas. We must have \F\ < C for some C > 0. 
Straightforward differentiation yields 

dp EQf s N (F(cr )) = s EGfJiH^a 1 ) - G^ N (H N (a)))F( 



Hence the absolute value of the derivative is bounded by 

sC EQ M \H N {a l ) - Qp tN (H N {a))\ 



Define /3(A) := \/ f3 2 + X 2 /N. By integration, we have the bound 



EG® 3 



(F(o-)) - EGfUF(*)) 



< sC 



EGp,N \H N {a) - gp, N {H N {a))\dp . (1.9) 



It remains to show that the integral goes to zero under the assumption. We have by Cauchy- 
Schwarz inequality 



/3(A) 



EQ^ \H N (a) - g^ iN (H N (a))\dP' 
< N 1/2 (f3(\) - (3) l/2 



Jj E Gp>,N 



1/2 



H N (a) (H N (a))\ 2 d(3> 



Since /3(A) — f3 = + 0(^), stochastic stability in the sense of Definition 11.91 would follow 
by equation (jl.9p if the term in the parentheses divided by goes to zero as A^ — > oo. Define 
/jv(/9) := jjE log Z N ((3). fjq is famously convex. It is easily checked by differentiation that 
the integral to bound is exactly 

Since /3(A) — > (3, the above goes to zero by a simple result of convexity (see Lemma [3.6p as 
well as the assumptions on the existence of the limit and the derivative at (3. □ 
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A direct consequence of Theorem 11.41 is that stochastic stability as a property of the 
sequence becomes a property of the limit points. 

Corollary 1.11. If limj^^^ log Zn ((3) exists and is differentiable at (3 > 0, then the 
limit points in the space of ROSt's of the sequence (Q^' N ) are stochastically stable in the 
sense of Definition 1 1 . 5l 

Another notable application of the continuity of the cavity mapping is a proof that 
the Parisi functionals, entering in the Parisi formula of the SK model, are continuous as 
functionals on ROSt's. This is proved in Section 12.21 and can be seen as a generalization 
of a theorem of Guerra that proved the continuity within the subset of Ruelle Probability 
Cascades [H)J 0]. Assuming that the Ultrametricity Conjecture holds, this fact, together 
with Guerra's bound and Corollary ll.ll[ provides a proof of the Parisi formula for the SK 
model (and more generally, for mixed p-spin models with even p's). This is done in Section 

El 



2 The Cavity Mapping 
2.1 Continuity 

In this section, we prove the continuity of the mapping (jl.4p . Let ip be a function in 
with bounded derivative, < C for some C > 0. Assume without loss of generality that 
ip(0) = 0. Let z a standard Gaussian variable with law P z and expectation E z . Note that, 
under these assumptions, l^l- 2 )! — G\z\, and in particular E z [e m ^ z '] < oo for any m G K. 

Define 

G(v,z,l) : = e mv)+zV^M 2 ) . (2.1) 

In the cases ip{x) = x and i/j(x) = log cosh x, we have the simplification 

E z G(v^J)=e^e^-^ . 

When dealing with s replicas, that is v = (v 1 , ■■■,v s ) G B s and z = (z 1 , ■■■,z s ) where z has 
law P® s , write 

s 

G(v,z,l) := Y[G{v\z l ,l) . (2.2) 

i=i 

Consider the generalized cavity mapping fl 1 . 6 [) : 

fi(dv) E z G(v,z,l) 
/jl{E z G{v,z,1)) 

where l(v) is the cavity field with covariance v ■ v'. The proof of the continuity is the same 
when the covariance of the field is c(v-v'), for a suitable function c, if \\v || 2 in the definition of 
G is replaced by c(||v|| 2 ). We restrict ourselves to the case where c is the identity to simplify 
notation. 

Consider a function F = F(v, z, I) that depends measurably on s replicas, the Gaus- 
sian vector z and the cavity field. The main ingredient of the proof of continuity is an 
approximation in the spirit of the weak law of large numbers. 
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Lemma 2.1. Let /j, G M(B). Let F(v,z,l) be a function such that v i-)- E h Ef s [F(v, z, I) 2 } 
is a continuous function on s replicas. Let (v r ,z r ), r = l,...,n, be n independent copies of 
(v,z) sampled from (fi x P z )® s . Then 

E l (/I x E z f ns J2 F (v r , zV)-(|iX E z f s z, /)) j < ^ 

where C is a positive constant that depends on F but not on fx. 

Proof. Using the fact that under (/i x E z )® ns , the variables F(v r , z r , I), r = 1, n are i.i.d., 
we have 

(A* x E ^ ^ - (A* x ^ 2 > O) j 

= x E 2 )®'(f(v,*,0 2 ) - x E z r s (F(v,z))y 

<^xE z r s (F(v,z,l) 2 ) . 

Now integrate over the l's on both sides and use Fubini's theorem on the right-hand-side. 
By assumption, v i— > EiEf s [F(v, z, I) 2 ] is a bounded function on B s . The conclusion follows 
from this. □ 

It will be useful to impose stronger conditions on F(v,z,l), namely that F(v,z,l) is a 
function of the variables l{y l ) + z l ^l — H^H 2 , i = 1, s: 

F(v, z, I) = F{l{v l ) + *Vl- IHI 2 , i = 1, s) ; (2.4) 
and that for any m G M, 

t> h-> E'jE'f z, Z) m ] is a continuous function on s replicas. (2.5) 
Lemma 2.2. The function G(v, z, I) satisfies ( 12. 4ft and ( 12.51) . 



Proof. The dependence in G is uniquely on the Gaussian variables Z(t>*) + z*a/1 — IMI 2 , 
i = l,...,s. These variables have variance 1 and covariance v l ■ v\ i ^ j. Therefore the 
function v = (v l ,...,v s ) i— > EiEf s [G(v,z,l) m ] depends only on the inner products between 
distinct replicas v ,...,v s . By writing down the Gaussian integral EiEf s explicitly, we see 
that to prove it is continuous on B s it suffices to show that, for any m G M, the function 
v i — y EiEf s [G(v, z, l) m ] is bounded uniformly in v. By Holder's inequality, 



E,El 



\{G{v\z\iy 



8=1 



< n{^^[GK,^,/n} 1/s = E z [e sm ^] < oo, 



which shows the desired uniform bound. □ 

Theorem 11.41 is a straightforward consequence of the following result with F(v, z, I) = 
F(v). The idea of the proof is to linearize functions involving the measure \i x E z using the 
empirical approximation of Lemma 12.11 
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Theorem 2.3. Let F(v, z, I) be a function satisfying (12. 4p and (12. 5p and let G(v, z, I) be as 
in (12. 2p . Then the mapping 



(/ix E z )® s [F{v,z,l)G{v,z,l) 



P ^ EE, 

(jixE g )v[G(v,z,l) 

is a continuous functional on the space of ROSt's. 
Proof. We rearrange the image of the mapping, 

'(fix E z )® s (F{v,z,l)G{v,z,l) 

EE, " 



(2.6) 



(fxxE z )®° (G(v,z,l) 



(2.7) 



EE, (fjt x E z 



^J2 n r= 1 G(vr,zr,l) + d tM (G) 



1 s^n 

Tl 



where 



d^FG) := (fj, x E z f s (F(v, z, l)G(v, z, l)j - - ^ F(v r , z\ l)G(v r , z r , I) 

r=l 

1 - 

d^G) := (n x E z r s (G(v, z, G ( v ^ ^ ■ 

r=l 

We introduce the empirical average of / as a function on the n copies (v r ,z r )^ =l and the 
cavity field 



(2i 



In this notation, elementary manipulations of (12. 7p give 
'fax E g )®'(F(v,z,l)G(v,z,l) 

EE, " 



. N EEi (n x E z )® ns [F((v r ,z r ) r ;l) 

(jixE s )®'\G(v,z,l) 

\fi x E z )^ s (d^FG) - F({v r ,z r ) r ;l) d^G) 

EE, ^ 

(fixE z )^(G(v,z,l) 



(2.9) 



We now bound the absolute value of the difference appearing in the left-hand side of (12. 9p 
uniformly in the possible laws P. We write for simplicity 7 = \/2 and 7 = (1 — ^) _1 = 
We use Holder's inequality followed by Jensen's inequality and Fubini's theorem to get the 
following upper bound of the right-hand side: 



E^ ns {E,Ef ns \d^FG) - F((v r ,z r ) r ;l) d M (G)| 7 



1/7 



{Efi® ns (E,Ef ns [G{v, z, t)-l] 



l/ 7 
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The second term is bounded by a constant uniform in the laws P by Lemma I2~2l (Essentially, 
the term with negative power —7 is bounded because the Laplace functional of a Gaussian 
variable is well-defined everywhere.) As for the first term, by the triangle inequality, it is 
smaller than 



I E/j® ns (^EiEf ns I dfj,(FG) I ' 



1/7 



+ {E^ ns [E l Ef ns \F((v r ,z r ) r] l) d^G)\ 



1/7 



The first term is bounded by the same expression with 7 replaced by 2. By Lemma 12.11 
it is thus bounded by C / ^Jri uniformly in P. The second term is bounded similarly after 
an application of Holder's inequality with 7. We note that, in this case, the resulting term 
E^ ns (E l Ef ns \F((v r , z r ) r ; is bounded uniformly in the P's since 



El Ef ns [F((v r , On 7 1 < EtEf s [F(v, z, If*] {E t Ef s [G(v, z, l) 3 ^] } 



1/3 



N3 7 7l I 1 / 3 



E t Ef s [G(v,z,l)- 3 ^] 



1/3 



(2.10) 



where we have used Holder's inequality and Jensen's inequality. The right-hand side is 
bounded because of (12. 5 ft and Lemma 12.21 Putting all this together, we can write from (12. 9ft 
for a possibly different C, not depending on P, 



EE t 



(fixE z )® s (F(v,z,l)G(v,z,l) 



{nxE z )®s[G(v,z,l) 



- Efi® ns ( EiEf ns [F{(v r , z r ) r - 1)} 
C 



< 



n 



(2.11) 



The above approximation is useful because it is uniform in the laws P, and it linearizes the 
dependence on // (allowing the use of Fubini's theorem to exchange the integration E\ and 

If E and E' are two ROSt's with sampling measures \i and /j,', we have by ( 12. lip 



EE, 



(^x£/ s % Zl i)GKz,l) 



(jixE z )*'\G(v,z,l) 

'bi'xE z )® s (F(v,z,l)G(v,z,l) 

-E'E, 



< 



(jj,'xE z )*'\G(v,z,l) 

Efj® ns (EiEf n8 [F((v r , z r ) r ; I)]) - E' ^ ns ( E, E\ ""[F ((V. z r ) r : /)] 
2C 

+ 



n 



Since C is uniform in the choice of P, the continuity will follow if 

{v r ) n r=l ^E l Ef™[F{{v r ,z r ) r ;l)\ 
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is a continuous function on ns replicas. We have that 



E l ET s [F({v\z r ) r -l)} = E l El 



But the integration is on the ns Gaussian variables of the form l(v) + Zy/l — \\v\\ 2 that have 
variance 1 and covariance v ■ v'. Therefore the expectation is a function on ns replicas, 
since it depends only on the inner products between distinct replicas and not on their norm. 
It is readily seen from writing the Gaussian integral that the continuity will follow if the 
expectation is bounded as a function on B ns . But this is a consequence of (12.101) taking 
77 = 1. □ 

Compositions of cavity mappings take a simple form when if) is linear. This will be needed 
in Section HI 

Lemma 2.4. Let A, X' > 0, c be as in (II. 5p and P be the law of a ROSt. Iff is the image 
of P under $a,z c and P" is the image of P' under &y,i> c , then P" is the image of P under 
®V ^+x' 2 le- ^ n particular, iff is invariant under $a,« c; then it is invariant under Q^/rxi f or 
any T G N. 

Proof. The second statement follows directly from the first. Let [i be the sampling measure 
of P. Then «' = $A,i c / i * s the sampling measure of P'. By the definition (II. 6p of the mapping, 

X ' ,l ' cfi ~ ^'(e^H-^NI 2 ) ' 

and by the definition of //, 



\'l' c {v)+\l c {v)- 



The claim follows from the fact that X'l' + Xl c V A' 2 + A 2 l c . □ 



2.2 The Parisi Functionals 

Theorem 12.31 that proves the continuity of the cavity mapping also provides continuity for 
an important class of functionals on ROSt's, the so-called Parisi functionals. They enter in 
particular in the Parisi formula for the free energy of the SK model. 

Let if) G C 1 (M) with bounded derivative and with if>(0) = 0. Consider a cavity field l c 
with covariance Ei[l c (v)l c (v')] = c(v ■ v') for some function c as in (II. 5p . Define the Parisi 
functional for a ROSt P and parameters A > as 

V{X, P) := E Eh log (u x E z ) (^P^c{v)+\ Zy Ji~c(\\v\\^ 

where z is a standard Gaussian variable with expectation E z . We drop the dependence on c 
and on if> in the notation for simplicity. The cases where if){x) = log cosh x or if)(x) = x, and 

p>0 p>0 
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will play an important role in Section [3j In these cases, the variable z can be integrated. 
The functional (I2.12p reduces to 



2 



P(A,P) := y +E Ei Jlog/i^^^^^^^o^ll-ll 2 ^] , (2.13) 

where A = (A p ) p > and £j is the expectation over independent cavity fields l p , p G N U {0}. 
The dependence on each A p is emphasized here by writing P(A,P) instead of P(A,P). 

Continuity of the Parisi functional on the subset of Ruelle Probability Cascades has been 
established by Guerra [15]. In this case, the Parisi functionals equals /(0, 0), where f(q,y) 
is the solution of a p.d.e. with final condition f(l,y) = ip(\y), see e.g. |3J H] for details. It 
turns out that continuity properties of the Parisi functionals that are needed in the proof of 
the Parisi formula can be established for the whole space of ROSt's. 

Proposition 2.5. Let P(A,P) be as in 02.121) . Then, for any ip G C 1 (M) with bounded 
derivative and c as in (ll.5p . 

1 . IP i — y V(X,P) is a continuous functional on ROSt's for every A > 0. 

2. In the cases where if)(x) = logcoshx and ip(x) = x as in (12.131) . it holds for any 5 > 
and any given X' = (\' p ) p >o G I 2 that 

if\\X- A'|| 2 < 5, then mzx \V(\,F)-V(\',F)\ < K\\X - A'|| 2 

where K > depends on X' and S. 

Proof. We prove the first claim. We show that P(A,P) is differentiate in A and that the 
derivative is a continuous function on ROSt's. The conclusion follows by integration. 
We write for short 

g(v,z):=l(v) + zy/l-c(\\v\\*) , 

omitting the dependence on I. Note that under EiE z , the g's are all centered Gaussian 
variables of variance 1. Suppose first that the derivative can be taken inside the expectations 
E Ei and fi x E z , then one would get 



d x V(\,F)=EEi 



(// x E z ) (g(v, z)ip'{Xg(v, z )) e ^(M) 



(/i x E z ) (t 



ip(\g(v,z)) 



(2.14) 



By Theorem l2.3l the derivative will be continuous as a functional on ROSt's if g(v , z)ip'(\g{v } z)) 
satisfies (12 .4p and (12. 5p . This is straightforward since ip' is bounded. 

It remains to show (I2.14p . The derivative can be taken inside the expectation KEi if we 
show that for 5 small enough 

1 / (/iX E z )(e^ Xg( - v ' z ^ S 
SU P M ^ EEl lo § ) vl <°°- ( 2 - 15 ) 

|A-V|«5 (A — X'Y y ( x E J ( e ^X>g(v,z)) 
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This effectively demonstrates the uniform integrability of the collection of random variables 
indexed by A with |A — A'| < 8 and given by 



1 



A- A' 



log(/i x E z )(e^ X9{v ' z)) ^ - log(/i x E z ){e^ x ' 9{v ^ 



Write R(X,X') for the random variable inside the log in (I2.15p . We split the integration for 
the events {-R(A, A') < 1} and {-R(A, A') > 1}. The expectation in (12 . 1 5[) becomes 



EE, 



(logi?(A,A')) 2 ;i?(A,A')>l 



+ EE, 



(log^A')- 1 ) 2 ;^,^)-^! 



Since logx < x — 1 for x > 1, we can bound the above by 



(fi x E g ) (e^ Xa( - v ' z ^ - e ^'a(v,z))\ 



(ji x E z )(e^ x a{v,z)) 



\fi x E z ) ( e ^ x ^ v ' z)) - e ^ A '»(«>*)A 

m i ^ — ^ — l | . (2.i6) 

(jj, x E z )[e^ x '9{^)) 



Using successively Cauchy-Schwarz inequality followed by Jensen's inequality on each term 
yields the upper bound 



EE, 



(fi x E z ) (>( A s(^)) _ e Wfl(«.*)) 



1/2 



x EE 



(fixE z )(e-^ x ^A]y /2 



+ ( EEi 



^xE z )(e-^ x '^)]) l ' 2 \ (2.17) 



The terms in the second bracket can be integrated by Fubini's and since the fields g(v, z) all 
have variance 1 under EiE z , the dependence on E drops leaving 



E z [e 



-4tp(Xz)-\ 1 / 2 



1/2 



The fact that < C and ?/>(0) = implies that ^(Az)! < AC|z|. And since |A — A'| < 5, 
\i J {Xz)\ < C(X' + S)\z\. Hence after integration, the term in the parentheses is seen to be 
uniformly bounded by a term that depends only on A' and S. It remains to bound the first 
term. After a use of Fubini's theorem, since the fields g(v, z) have variance 1, it is simply 



E z (e*M-eW*y 



1/2 



(2.18) 



Taylor's expansion around ip(X'z) gives for a certain z between X'z and Xz, 



e iP(\z) _ e K\'z) = (\ — X')z^'(z)e 



(2.19) 
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The latter is bounded above by C\X — X'\ \z\e c ^ z ^. The assumption on z readily implies that 
\z\ < \ Z \(X + Plugging all this back into (I2.18p . we get a bound after integration of z 
which is (A — A') 2 times a constant that depends only A' and 5 . Since the term (A — A') 2 
cancels with the one in ( I2.15p . it follows that the differential operator can be passed through 
EE t . 

To prove (I2.14p . it remains to show 



d x log(fi x E z )[e 



x E z )(g{v,z)tp'{Xg{v,z))e^ x ^ v ^ 



(fi x E z ) ( e^ x 9(v,z)) 

This is straightforward once it is established that 

d x (fi x E z ){e^ X9 ^) =(fiX E z )(g{v,z)^\Xg{v,z))e^ x ^ 

To do so, it suffices to justify taking the derivative inside fi x E z by showing 

sup 7T 1 ^J fJ- x E z ) ( e ^ Xa(v ' z)) - e ^'9M)\ 2 < oo . 
|A-A'|«5 (A - X') 2 \ J 

Using the expansion (I2.19p with g, the above is bounded by 

C 2 (fixE z )(g 2 e 2C ^ +5 ^). 



(2.20) 



(2.21) 



The expectation is finite P;-almost surely as can be seen by integrating over /. (12.201) follows. 
To prove the second claim of the proposition, it suffices to show 



log 



file 



^(E p VpM)-|E p a2|M| 2 p 



< K\\\-\'\ 



(2.22) 



since the functional A t— > -y in (12. 13[) obviously obeys a similar bound for ||A — A'||2 < <5. 
We write K for a generic term that depends on A' and S only. Bounding the logarithm as 
it was done after (I2.15p . one gets that f !2.22p is smaller or equal than a term bounded on 
{A : || A - A'|| 2 < 5} times 



EEi ^ e ^ {E P V ^ )) e-5£p A pNI 2p _ e i>(E P W v )) e -h^ P K 2 M\ 2p 



1/2 



By adding and subtracting e^^p Xplp( - v ^e 2^ P X pW v W p an d using the triangle inequality, this 
is smaller than 



EEi ^Je" E p A > i|2p (e^ Xplp{v)) - e ^E P ^ ! pW)) 



1/2 



+ 



1/2 



The terms e ^pVMI p an d Ei e 2 ^^f VpM) are uniformly bounded on B and on {A : ||A 
A'||2 < <5}- Moreover, for ip = logcoshx or if)(x) = x, one has (e^ x > — e^^) 2 < (x 
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^) 2 e 2 M+2|y| Therefore, applying Cauchy-Schwarz inequality, the claimed bound follows for 
the first term from the fact that X p l p (v) has bounded exponential moments on B and on 
{A : ||A — A'|| 2 < 5}, and that 

M E( A *> - W v )) 4 = 3 f E( A * - K) 2 \M 2p ) < 3ii A - A 'ii2 • 

p v p / 

As for the second term, the bound follows from 

| C -*E,A>II* _ e -*5^A>||*| < I J-Xl- A; 2 < K||A- A'|| 2 . 

p 

□ 



3 The Parisi Formula from the Ultrametricity Conjec- 
ture 

In this section, we show that the Ultrametricity Conjecture [I] together with Corollary 11.111 
and Guerra's upper bound [T5] yield an alternative proof of the Parisi formula for the SK 
model (and more generally, for mixed p-spin models with even p's). The main new result 
is Theorem I3.5[ which gives a lower bound for the free energy in terms of a functional of a 
limit point of the sequence of Gibbs measures in the space of ROSt's. The proof uses the 
treatment of Talagrand for the high-temperature regime (Theorem 2.4.19 in [29]) and the 
continuity of the Parisi functionals on the space of ROSt's. The compactness of the set of 
ROSt's that are invariant under a family of cavity mappings, which is a consequence of the 
continuity of such mappings, will also be crucial (see Corollary 13. 7]) . The Parisi formula is 
then a consequence of Guerra's bound and the Ultrametricity Conjecture. 
The p-spin Hamiltonian H P N on {— 1, +1}-^, 

m^eH+lf), 

is a centered Gaussian vector with covariances EH^ r (a)Hp f (cf J ) = NR(a, <r') p , where R(a, a') = 
~k J2iLi a i a 'i- Such a process can be represented as 

1 N 

ii,...,i p =l 

where gi 1} ... t i p are standard Gaussians that are independent for distinct indices ...,i p ). In 
this section, we will be concerned with the mixed Hamiltonian 

p 

where the summation is restricted throughout this section to p — 1 and even p's. Take 
j3 p G R + for simplicity since has the same law for positive and negative values of the 
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parameters. For the appropriate cavity field to be well-defined, the parameters (3 := (f3 p ) 
will need to decay so that 

E 2P /? <o °- ( 3 - 2 ) 

V 

(We stress that this decay is most likely not optimal.) The /3's satisfying ( 13. 21) form a Hilbert 
space under the inner product (3 ■ (3' = J2 p ^ p PpP' P - The norm is then ||/3|| 2 = J2 p 2 p (3p- 
The Gibbs measure at the value (3 of the parameters is 

expH N (a) 
~ Z N (f3) ' 

where Z N {(3) = exp H N (a). As mentioned in Section [L2| a ROSt can be constructed 
from the random probability measures {Qp^)- The corresponding sequence of laws will be 
denoted by (P^at)- The corresponding sampling measures defined through (11.71) will be 
denoted by (/i^at)- Since the space of ROSt's is compact, the sequence (P/3,jv) has limit 
points. We will denote a generic limit point by and its sampling measure by 
Our goal is to express the free energy of the Hamiltonian 

f{{3) := lim ±-ElogZ N {{3) 

N— >oo iv 

as a functional of a limit point P^. For the mixed Hamiltonian with p = 1 and even p's, the 
existence of the limit was proved by Guerra and Toninelli [17] . We also know from the work 
of Guerra [T3] and Talagrand [30J that f{(3) is expressed by the celebrated Parisi formula. 
We write it here in terms of Ruelle Probability Cascades (RPC's). The reader is referred to 
[1] for the correspondence between this formulation and the one in terms of PDE's. 

Theorem 3.1 (The Parisi Formula). For any (3 satisfying ( 13. 2\\ . we have 

f((3) = log 2 + mm \v{\^ P) - £ (i _ E ^ (l7 . tff) 

I p 

where V is the Parisi functional (12.131) with ip(x) = log cosh x, and (A i3 ) p _ 1 = ^fp f3 p forp = 
1 and even p 's and zero otherwise. The minimum is over the laws of the Ruelle Probability 
Cascades, a compact subset of the laws of ROSt's. The sampling measure o/P is denoted by 
fi. 

It can be checked that for any ROSt that is stochastically stable for the cavity fields l p , 
so in particular for the RPC's, the second functional in the Parisi formula, 



P h. (P (l - E/i > ■ u') P ) 



p 



is equal to the Parisi functional ( 12.1 3D for ip(x) = x, A 2 = J2 P i.P ~~ an d c ( x ) 



A 2 X ■ 

The proof in [30] of the Parisi Formula is not constructive. Our goal is to provide 
a constructive demonstration in the spirit of Aizenman, Sims and Starr [3] and Theorem 
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2.4.19 of [29] by assuming that the Ultrametricity Conjecture holds. This way of proceeding 
is based on general properties of ROSt's. Moreover, we emphasize that we will not use the 
ultrametric structure of the RPC explicitly, but simply that the stochastic stability properties 
characterize the RPC family from the conjecture. 

The first ingredient of the proof is an upper bound proved by Guerra 



Theorem 3.2 (Guerra's bound). For any RPC with law P and sampling measure fi, 

f{(3) < log 2 + V{\p, P) - J2 iP i 1 - E ^( v ■ V ') P ) ■ 

p 

Guerra's proof is based on an interpolation between a cascade with a finite number of 
levels and the Gibbs measure Gp t N- It uses explicitly the tree structure of the cascades. The 
proof of this bound can be also done using the approach of Aizenman, Sims and Starr [3]. 
In this case, the proof does not use the ultrametric structure of the cascade explicitly, but 
simply the stability of the cascades under the cavity mapping with function ip(x) = log cosh x 
and i/j(x) = x. The reader is referred to [3j 0] for more details. 

It remains to establish the matching lower bound. We begin by a standard lemma, whose 
proof using Jensen's inequality will be helpful in this section. 

Lemma 3.3. The function (3 t— > f(/3) is convex and continuous in the space of (3 satisfying 

Proof. We set /jv(/9) := jrE log Z N (f3). The fact that /jv(/3) is convex follows by Holder's 
inequality, and the convexity of f{(3) is proved since it is the pointwise limit of /at(/3). We 
now show that the family (/W(/3))at is equicontinuous in (3. 

First note that /at(/3) is an increasing function of its parameters, since by Gaussian 
integration by part, 

D p f N (P) = P p (l - EG® 2 N R(a, a'r) > , (3.3) 

where D p is the partial derivative in the p-th coordinate. Let f3 and f3' satisfy (13.21) . Let us 
define f3~ with (3~ := min{/3 p , (3' p }. By construction, /at(/3 _ ) < In {(3) and /jv(/3 _ ) < In{I3'). 
We show that 

f N {(3) - M/r ) < ~ J2(P P ~ dp? , ( 3 - 4 ) 



2 

p 



and similarly for /jv(/3'). We observe that 



f N {(3) - f N (J3r) = ^EE'logg^- >N {expH' N {a)), 

where H' N (a) is defined as H N , but is independent of H N and has parameters (\J fi P ~ iP P ) 2 

We write E' for the expectation on H' N . By Jensen's inequality with log and using the hide 
pendence between H' N and Q$- , this is smaller than 



p 



log^jVexpi^))] = Ij^K ~ ^v?) 
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since E' exp H' N (a) - 
definition of (3~ that 



JV [ 

e 2 



(<3 P (/3p ) ) fj^g p roo f j s identical for (3'. This implies from the 



2^ vp v p/ / - 2 

p p 

Since the continuity is uniform in N, the equicontinuity is proved. It follows that f{(3) is 
continuous in (3 in the sense of the norm ||/3|| 2 = Y2 p 2 p (3p- □ 

It is well-known that a convex function on R is differentiable almost everywhere. It 
turns out that a similar statement is true for a continuous convex functional on an infinite- 
dimensional space. Indeed, it is a theorem of Mazur that a continuous convex functional on 
any open convex subset of a separable Banach space has a dense set of points of differentia- 
bility (in the sense that the directional derivative exists in all directions), see e.g. Theorem 
1.20 in |22j. Applying this to the Hilbert space of (3 satisfying (13. 2p . we get 



Lemma 3.4. The set of parameters (3 for which 

f(P + tP 



lim 



t 



exists for any (3' 



(3.5) 



is dense in the set of parameters satisfying 

The main ingredient entering in the lower bound is the following result. 

Theorem 3.5. Let (3 be a point of differentiability of f . There exists a subsequence of{Fp^) 
that converges to Fp, the law of a ROSt with sampling measure fip, for which 



f((3)>\og2 + V(\p,Fp)-J2 



(P ~ 1)/3 P 2 



1-Efif(vv') p 



(3.6) 



where V and \p are as in Theorem \3.1\ 

To prove the assertion, we shall need a standard result of convexity. We omit the proof. 

Lemma 3.6. Let f^ : M A/ — > R be a sequence of differentiable convex functions that con- 
verges pointwise to f . Suppose f is differentiable at x e R M . Then for any sequence x^ 
converging to x, 

lim Vf N (x N ) = lim Vf N (x) = V/(x). 

N—>oo N—>oo 



Proof of Theorem \3.5[ We show that 



lim inf E 



log- 



03) 



Zn(P) 



(3.7) 



equals the right-hand side of ( 13 .6p for Fp, a limit point in the space of ROSt's of (Fp jNk ) k 
where (iV/^ achieves the above lim inf. The result then follows from the existence of the 
limiting free energy and the fact that 



lim f N {(3) 



1 - 

lim — \^E 

jV->oo TV ' 



n=l 



log- 



J n+1 



09) 



ZM J 



> lim inf E 



log- 



'N+l 



09) 



Z N (J3) J ' 
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Taking (3 + := where /3+ = f3 p (^p)^ , we can decompose the ratio in (13.71) as 

Z N+1 (/3 + 



E 



log 



Zn{P) J 



E 



log 



J 



(3.f 



We handle the first term. A straightforward calculation using the representation (13. ip yields 
for H^j on Af + 1 spins, 



3p — k 



k=0 



where the second sum is on p-tuplet I/~ = (ix,...,i p ) with exactly k coordinates equal to 
N + 1 and the other coordinates, denoted by (ji, j p ~k), run from 1 to N. In particular, 
the covariance becomes 



E[f3+H p N+l (a,a N+1 )f3+H p N+1 (a , ,<r' N+1 )} = ^ p E[H p N (a)H p N (a')} + p^ p a N+1 a' N+1 R(a, a 



/\ P -i 



fc=2 



<J N+l a N+l' 



R(a, 



a 



i\p—k 



(3.9) 

We denote by l c {a) the cavity field with covariance c(R(a, a')) = J2 P ^? L R(.< T i cr ') P ~ 1 where 

Aj| = J2 P PPp> an d by e(cr, <Jn+i) the field of covariance given by the sum over all p's of 
the last term of (13. 9p . Note that these fields are independent of each other and of H^(a). 
Moreover, the variance of e is smaller than 



-V5 2 VM — *— < — V 6 2 2 p = — 
N Z^^AUJ N k-2 - N Z^i j p N 

V k=2 y 7 p 



(3.10) 



for some finite constant C under the assumption (13. 2p on the decay of /3 P . 
The term Z N+ i(f3 + ) can be rewritten using (13.91) and we get 



E 



log 



Zn + i((3 + ) 
Z N ((3) 



E E t E e 



logG 



;. A j ^ exp{A i ao- w+ i/ c (o-) + e(a,a N+ i)} 

. 0"JV+1=±1 



where E is understood to be the expectation on Gp,N on the right-hand side, and E\ and E e 
are the expectations on I and e respectively. Using Jensen's inequality and the independence 
between / and e we get from (I3.10p 



E 



log- 



-'AT+l 



-EEi[\ogg p>N (2coshA /3 Z c ( ( r))] 



Z N {(3) 

Therefore the first term of (13.81) is, up to a term of order 1/N, 

log2 + V(X^ )N ) , 



< 



C_ 
N 
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where P^jv is the law of the ROSt constructed from Qp^. Let Fp be a limit point of (P^ jvJ, 
where (Nk) achieves the liminf of (13. 7p . The continuity of the Parisi functional proved 
in Proposition 12.51 gives the first two terms of (13.61) . It remains to prove that along this 
subsequence 



E 



log 



J N k +l 



(/3 H 



J N k +l 



(0) 



E 



(p - ih 2 



i 



(3-11) 



The idea is simply a Taylor expansion in /3, but since we are dealing with infinitely many 
variables, we proceed with care. We define (3^ with components (3 p for p < M and P for 
p > M. Using Jensen's inequality and the summability of (3, for any 5 > we can find M(5) 
independently of N such that for M > M($) 



< E 



log 



J N+1 



<n+i((3 m 



p>M 



+ 2 
V 



Pi) < $ 



Fix such a 5 and such a M. By the mean- value theorem on M A/ , 
P P <P P < 0} for p < M and /3 p = /3 P for p > M such that 



there exists f3 M with 



log 



J N+1 



09) J 



E ^05 

p<M 



Pp)DpfN + i((3 M ) . 



We know that /W(/3) is a convex function of /3. Thus, by Lemma T3.6I and the assumption on 
differentiability of /(/3), 



lim ^2N(p;-P p )D p f N+1 (M 



lim D^OS) 



p<M 



^ 2 

= E^^( 1 - E ^ 2 (---T) , 

p<A/ 

where we used f)3.3p in the last equality as well as the continuity of the function P i-)- 
E / u (gl2 (f • v'Y in the space of ROSt's. Since 5 was arbitrary, the theorem is proved. □ 



The connection between the lower bound of Theorem 13.51 and the actual Parisi formula 
with RPC's will be provided by the Ultrametricity Conjecture. The idea is to use the lower 
bound of Theorem 13.51 for (3 where (3 P > for all p's. The limit ROSt's P73 for such a choice 
possesses strong invariance properties by Corollary 11.111 if j3 is a point of differentiability 
of /. However, it is not guaranteed that (3 is a point of differentiability. Even worse, 
Mazur's theorem does not ensure that the points of differentiability are dense in the subset 
{(3 : (3 P > Wp} since it is not open. This apparent difficulty is however bypassed by the use 
of subsequences and by the continuity of the cavity mapping. 

Corollary 3.7. Let (3 with /3 P > for p = 1 and even p's. There exists a ROSt of law Fp 
and sampling measure p,p that is stochastically stable for the cavity fields l p , p = 1 and all p 
even, and for which 



f((3)>log2 + V(\p,Fp)-J2 



(p 



Efif(v ■ v'f 
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Proof. By Lemma [3.41 there exists a sequence of points of differentiability f3 m , m G N, that 
converges to (3. Hence the inequality (13. 6p is satisfied for any f3 m for some ROSt's of law 
Pa . Recall that P« is the limit law of the ROSt's constructed from the Gibbs measures 
Gp m ,N- It follows from Corollary 11.111 that P J a m is stochastically stable for the cavity fields l p 
for all p < p(m), where p(m) < oo is the greatest p such that ((3 m ) p > 0. Since the space of 
ROSt's is compact, there exists a subsequence of m's for which Fp m converges to the law of 
some ROSt denoted Fp. Moreover, since the cavity mapping is continuous, any limit point of 
a sequence of laws that are invariant under a cavity mapping is also invariant. This implies 
that P/3 is stochastically stable for the cavity fields l p for all relevant p's (since p(m) goes to 
infinity with m from the hypothesis that (3 P > for all p). 

By Lemma [3731 f((3 m ) —> f(fl)- To prove the inequality (13.61) for (3, it remains to show 
that the right-hand side also converges for the considered subsequence of f3 m . This is clear 
for the second term since (3 m — > (3 and P / 3 m — > P^. For the second term, one has 

< rn^ t \P(X 0m ,¥)-P(X ,¥)\ + \V{\^ PjJ - V(X , . 

The right-hand side goes to zero along the subsequence of j3 rn by Proposition 12.51 because 
P /3m ^P^and||A /3m -A^|| 2 = E P M(/3 m )p-/3 p 2 )<ll/3 m -/3||. ' ' □ 

Proof of Theorem \3.1\ using Conjecture^ By Conjectured! the only stochastically stable 
ROSt's for infinitely many p's are convex combinations of RPC's. Therefore, by Corollary 
13.71 and Guerra's bound, the Parisi formula is established at any point (3 with f3 p > for all 
p. (Note that the functionals that are minimized in the Parisi formula are linear functions in 
the law of the ROSt's. In particular, the minimum can be restricted to RPC's as opposed to 
convex combinations of RPC's.) It remains to show that the Parisi formula holds at all (3, 
including those (3 with (3 P = for some p. Since / is continuous in the space of parameters 
satisfying (13. 2ft . it suffices to show that the functional 



(3 ^ mm j^, P) - £ {V (l - E^(v ■ v'f) J (3.12) 

is continuous under the norm \\(3\\ 2 = Yl p 2 p P p - We write for convenience A(/3,P) for the 
functional in the argument of the minimum. By Proposition I2.5[ A(/3, ■) is a continuous 
functional on ROSt's. We denote by P^ the RPC where the minimum of A(/3, ■) is attained. 
Since we minimize A over ROSt's, we have trivially 

A(/3,P/3) - A(/3',P/3) < p mmA(/3,P) - p mmA(/3',P) < A(/3, P^) - A(/3', P^) . (3.13) 

On the other hand, if (3 is close enough to f3', we have for some K > 0, 

max |A(/3,P) - A(/3',P)| < K\\f3-(3'\\ . 

PROSt 



This is because, by the second part of Proposition 12. 5[ 



( 1 1/2 f ' 2 

ma* \V{\p,P) - P(W)I < K - ft) 3 1 ^ K |S 2P( ^ ~ ft )2 
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and the same holds by inspection for the second functional entering in the definition of A. 
The continuity of ( I3.12p in the space of f3 satisfying ( 13. 2 p follows from ( I3.13P and the above 
estimate. □ 



4 Properties of Stochastically Stable ROSt's 

Some particular properties of stochastically stable ROSt's were essential in the proof of the 
ultrametricity conjecture in [5] and [23], where strong assumptions on the ROSt were needed 
(e.g., finiteness of the support for the law of the entries). Here we show similar properties in 
a general settting which may be useful for the proof of the conjecture in the general case. 

A direct consequence of the continuity of the cavity mapping is the compactness of the 
set of stochastically stable ROSt's. 

Corollary 4.1. The set of laws of ROSt's that are invariant under a (possibly infinite) 
family of cavity mappings of the form (II. 6p is convex and compact. In particular, the set of 
laws of the stochastically stable ROSt's is convex and compact. 

Proof. Convexity is clear. The compactness of the set of laws of ROSt's that are invariant 
under the mapping (II .6p for a given ip and a given positive definite form c is a consequence 
of continuity of the mapping (Theorem II .4p . Compactness also holds for sets of ROSt's that 
are invariant under an infinite number of mappings (e.g., for all parameters A > 0) since in 
a compact space an arbitrary intersection of compact sets is compact. □ 

Corollary 14. 1 1 yields a standard ergodic decomposition for the different sets of stochasti- 
cally stable ROSt's by Choquet's theorem: the law of a ROSt in such a convex set can be 
written as the bary center of some probability measure on the extreme points of the set. This 
is useful since many functions of interest on the sampling measure of a ROSt turn out to be 
constant when the law is an extreme point. This is helpful when proving properties of the 
sampling measure of stochastically stable ROSt's. 

Definition 4.2. We say a function h : Ai(B) — > R is an invariant function of the cavity 
mapping $^,/ c defined in (II. 6p if: 1) it is Borel measurable; 2) for any isometry T of B, 
h(fi) = /i(T _1 /i); 3) h(fi) = /i($^ c yu) Pi-almost surely. 

Lemma 4.3. Let h : M.(B) — > R be an invariant function of a (possibly infinite) family of 
cavity mapping (&^,i c ), where the collection is over different ip's and c's. Let P be the law 
of a ROSt with sampling measure fi. If P is an extreme point of the set of laws that are 
invariant under the family ($^ )j / c ), then the random variable h(fi) is constant F-a.s. 

Proof. If h is not a constant, we have the non-trivial decomposition of P 



On the other hand, P( • \h(fi)) is invariant under the same family of mapping ($^,i c ) for 
P-almost all h(fi). Indeed, for any Borel measurable function g on A4(B), invariant under 
isometry, any Borel measurable function F : R — > R, and every ( I ) ^ i z c in the collection, 




(4.1) 



E\g(ji)F{h(fi))]=EE l \g(^ >lo 



li)F(h($^))} = E£,[0($^)F(%))] 
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where the first equality follows from the invariance of P and the second, from the invariance 
of h. Thus (14 .lj) contradicts the assumption that P is an extreme point and the claim 
follows. □ 

By inspection of the form of the cavity mapping (11. 6p . we expect that the support of a 
measure \x is not affected by the cavity mapping, since the mapping modifies only the weight 
of the vectors and not their relative position. We make this idea precise in the following 
lemma. 

Lemma 4.4. Let // G J\4(B) and $^,i c as in (jl.fip . Then &^,i c [J> is equivalent to /i Pi- almost 
surely, that is: for any non-negative measurable function f on B, 

f(v) fi(dv) = if and only if / f(v)<&ip : i c [i(dv) = Pi-a.s. 

B JB 



Proof. Note first that 



f(v) E [p^(^)+ 2 V'i-^NF))i 
//(^[e^^W^NP))]) 



B JB 



hence the left-hand side is zero if and only if f B f(v)E z [e^ lc{v)+z ^ l - cm2)) }{i(dv) = 0. Now 
if J B f{y) fi(dv) = 0, then we must have that f {v) = /i-a.e., which implies 



f^E^^+^-^^Mdv) = . 

On the other han d, we note t hat E z [e^ {lc{v)+Z V 1 -^ 2 ^] > P r a.s. and /i-a.e. This is 
because l c (v) + ZsJ\ — c(\\v || 2 ) is finite Pi x P 2 -a.s. and /i-a.e., since by Fubini, 



E t E z / \l c (v) + 2v /l-c(||i;|| 2 )| 2 n(dv) = 1 . 



B 



Therefore if f B f{v)E z [e^ v)+z V l -< M2)) }ii{dv) = 0, then f(v) = /i-a.e. also. □ 

Functions on j\4(B) that only depend on the support of the measure typically turn out 
to be invariant functions of the mapping in the sense of Definition 14.21 This simple fact can 
be used to investigate the support of the sampling measures of stochastically stable ROSt's. 
Here we look at two examples below: the dimension of the support of the measure and 
whether or not the support lies on a sphere. We will need three invariant functions of the 
cavity mapping. 

The first two are 



^min(/i) := inf jo < r < 1 : fi{v G B : ||u|| < r} > j : 
r max (/i) := sup |o < r < 1 : fi{v G B : \\v\\ > r} > j 



(4.2) 
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Essentially, r min represents the inner radius of the support of fi and r max , the outer radius. 
The requirements of Definition 14. 21 are fulfilled by these two functions for any cavity mapping 
$^ c . Indeed, both functions are measurable since 

{fi G M(B) : r min (/i) <s}= |J {// g : MII^H < s'} > 0} 

»'6Q, 0< S '<s ^ ^ 

{fi e M(B) : r max (/i) > s}= |J {//GA<(£)://{H> S '}>o} , 

s'£Q, s<s'<l 

and the functions /i || < s'}, // >->■ || > s'} are Borel measurable for the weak-* 

topology on They are invariant under an isometry T of B since the norm of a vector 

is. The fact that r min (/i) = r min ($ v , j/c /i) and r max (/i) = r max (<I>^ c //) is direct from Lemma 
I4.4[ since the latter implies Pz-a.s. 

G S : |H| < s} > <^=^ $^ i/c /i{f G S : < s} > 
G B : |H| > s} > <^=^ $.0 iic /i{w G S : ||v|| > s} > . 

The third invariant function we need is the dimension of the smallest subspace that 
contains the support. One way to make this precise is as follows pQ. Let \i G M.(B). Define 
(weakly) the covariance operator on % as 

for all v',v" G H, v' ■ (C^v") := / fi(dv) (v' ■ v)(v ■ v") . 

Jb 

It is easily checked that C M is a self-adjoint, trace-class linear operator on %. (It is trace- 
class, since for a standard basis {e;} of "H, Tr = J2i e i ' (^n e i) = JgM^OIMI 2 — !■) m 
particular, it is compact, thus admits a basis of orthonormal eigenvectors for %. We write 
{Aj(/x)} for the non-zero eigenvalues. We write for the eigenspace corresponding to the 
non-zero eigenvalues. We have H = © Hj;. It is easily verified that n,(H~t D B) — 0. We 
define 

dim// := #{2 G N : A;(/i) > 0} = dim?^ . 

We claim that the function \i y dim fi is an invariant of the cavity mapping $>^,i c for any i[) 
and c. Standard arguments show that it is measurable with respect to the Borel cx-algebra of 
M.(B). It is readily checked that eigenvectors of \x are mapped to eigenvectors of yuT -1 for any 
isometry T of B, therefore dim /a = dim fiT^ 1 . It remains to show that dim /a = dim$^ c /i 
Pi-a.s. We have v G Hh f~l 25 if and only if 

«•((>) = [ fi(dv) (v,v) 2 = 0. 
Jb 

By Lemma 14.41 this is true if and only if 

/ §i,,i D n{dv) (v,v) 2 = v ■ (C^ , cA , v) = 0, 
Jb 

which in turn is equivalent to v G ( M PI £>. The claim follows. 

The following result on the dimension of stochastically stable ROSt is a generalization of 
a result for competing particle systems which states that no system with a finite number of 
particles can be quasi-stationary [25] • It is rather surprising that it holds for ROSt whose a 
law is invariant under a single cavity mapping. 
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Theorem 11.71 Let P be the law of a ROSt that is invariant under the cavity mapping $^ / 
for a given A > 0. Let fi be its sampling measure. Then 



P(dim fx = 1 or dim fx = oo) = 1 . 
In other words, fx is supported on a single vector or on an infinite- dimensional subset of B. 

Proof. For simplicity, we set A = 1. By relying on the Choquet decomposition, it suffices 
to show the assertion holds when P is an extreme point of the set of laws invariant under 
$u. Since fx i— > dim fx is an invariant function of the mapping, Lemma [4.31 implies that it is 
constant with P-probability one. Suppose 1 < dim fx < oo. We first prove that this implies 
that the sampling measure fx is supported on a sphere P-almost surely, that is, there exists 
a deterministic r > such that fx{v G B : \\v || = r} = 1 for almost all fx. Indeed, since 
fi i — y r m[n (fx) defined in ( 14. 3 p is also an invariant function, it is constant P-a.s. This constant 
will henceforth be written simply as r min . For any r > r min and e > 0, consider the ratio 

/x{v G B : lldl > r + e} . t t . 

r ~ ' | I, ^ x • ( 4 - 4 ) 
fi{v G B : \\v\\ < r) 

We claim that the ratio is zero for any r > r min and e > 0. If so, we are done, since it implies 
that fi{v G B : \\v \\ > r} = for any r > r min , hence that fx is supported on the sphere 
of radius r m ; n . By Lemma 12. 4[ P is invariant under the mappings &^fi for any T G N. 
Therefore the ratio (14. 4p has the same law as 



Since 1 < dim fx < oo, I can be seen as a Gaussian vector in a finite-dimensional space. We 
then have the bound — 1|/|| < l(v) < ||Z||, since \\v\\ < 1. A straightforward application of 
that bound and simple estimates shows that the ratio is smaller or equal to 

c 2VT\\l\\-$(2er+e*) »{ V E B : ll^ll > T + € J 

fx{v G B : \\v\\ < r} 

This proves the claim, since the above goes to zero as T — > oo for P/-almost all I. 

It remains to show that if fx has support in a finite-dimensional sphere, then it must be 
supported on a single vector. The idea is that fx must be supported on the vector where the 
cavity field is maximal. In a finite-dimensional space, v \- > l(v) is a continuous function for 
P;-armost a ll /. Since the sphere is compact, it achieves its maximum, say mi. Moreover, 
by independence of the l(v)'s in orthogonal directions, the maximizer, say vf, is unique. Let 
Ci(e) be a cap neighborhood of the maximizer on the sphere such that l(v) > mi — e for 
v G C/(e) and l(v) < mi — e for v G Ci(e) c . If the measure fx is not supported on a single 
vector, there exists an e such that J c / £ \ c e^ 1 ^ fx(dv) > 0. We then have 
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This shows that, for any e, the limit of the left-hand side as T — > oo exists and is infinite for 
P-almost all \x and P;-almost all I. But by invariance, the ratio on the left-hand side has the 
same law under P x P t as for a single application of $1^, i.e., 



fi(dv) 



This ratio is infinite for all e if and only if 

($i,tfx)K} = 1 P x P r a.s. 
We deduce by the invariance of the ROSt that \i must be supported on a single vector. □ 

One might expect that other properties of stochastically stable ROSt's might be obtained 
in a similar way leading to a better understanding of the hypotheses of the Ultrametricity 
Conjecture. If stochastic stability is assumed for an infinite number of cavity fields, we can 
prove more. 



Theorem 11.81 Let P be the law of a ROSt that is invariant under the cavity mapping &\ t i p 
for a given A > and for infinitely many p G N. Let [i be its sampling measure and suppose 



that ^ 2 {(v,v') G B 2 : vv' 



> on a set of positive P -probability. Then, 



fi{v G B : \\v\ 



= 1 F-a.s. 



In other words, fi is almost surely supported on a sphere. 

Proof. We set A = 1 for simplicity. In the proof, all p's refer to the infinite collection of p's 
for which invariance holds. By relying again on the Choquet decomposition, it suffices to 
show the assertion holds when P is an extreme point of the set of laws invariant under 
for all p's. Consider r min and r max defined in (14. 3p . Since they are invariant functions of the 
cavity mappings for all p, they are constant P-a.s. We suppose that r min < r max and 
show this leads to a contradiction. 

Pick 5 such that r min < 5 < r max . Let E>s = {v G B : \ 



< 5}. Note that since 



we must have that < ^(Bs) < 1 for P-almost all \i. 



By the invariance properties of the ROSt and Lemma 12.41 the following identity holds 
for all T G N and all p's 



E(m(B s ) = EE L 



, e VT Jp(t;)-!N|ap 



(4.5) 



Now pick a sequence (T(p)) p such that T(p)5 2p — > 0. (The choice of the sequence will be 
refined later.) Fatou's lemma then implies 



Efx(Bs) > Eliminf E x 

p— i-OO 



Ie 



m w-^imi 2 ^^) 



H e 



I p (v)-^\\v\\ 2 p 



(4.6) 
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We now show that for P-almost all fi, 



lim inf E[ 

p— >oo 



file 



lim inf E\ 

p— >oo 



fi(B s 



/T(p) l p (v)-^\\vpP 



file 



■ (4-7) 



Taking the difference of the two sides and applying Cauchy-Schwarz inequality, one gets 



E, 



l p {v)-\T{p)\\v\\^ 



2 , 1/2 

fi(dv) - fi(B s ) ) \ {Ei 



1 



file 



/T{p) I p ( v )-?M\\ V \\2P 



1/2 



The term inside the first bracket can be evaluated by developing the square and integrating 
over Ei to get 



?<p)Wn(dv)n(di/) - (fi(B 5 )f 



B 6 xB s 



which converges to as p — > oo by the choice of T(p). It remains to show that the term in 
the second bracket is bounded uniformly in p. By introducing fi(Bg), it is equal to 



1 



(M^)) 2 



Ei 



2-\ 



fi{B s 



Ie 



fi(dv) 



(Note that we used the fact that fi(Bg) > here.) The term in the expectation can be 
written in terms of the conditional measure /i( \Bg). Hence using Jensen's inequality, one 
gets the upper bound 



Bx)) 2 \ 1 5 J 



which is seen to be bounded by e 3T ^ s2p by integrating with Ei. 
Putting (14 .6p and (14.71) together yields 



Efi(B s ) > E 



fi(Bg) lim inf E t 

p— >oo 



1 



fry) i p (v)-^f\\vpp 



file 



And since 



E, 



1 



file 



> [Eifi e 



-1 



and fi(Bs) > P-a.s., this implies that 



lim inf E\ 

p— >oo 



1 



file 



1 P-a.s. 



(4- 
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By hypothesis, there must exist an a > such that the set of /i's with /i 02 {(t>, v') : v ■ v' = 
r max } > a has positive probability. We show that the equality f)4.8p cannot hold on this 

set. Fix a /i in this set. Write for simplicity m p := /x {^e^ 7 ^ sr^lMI In view of the 

fact that the function y i— >■ y^ 1 is strictly convex, a contradiction would be reached if we 
can construct along a subsequence of {m p ) p a random variable m that is fluctuating but for 
which E\m = EiirT 1 = 1. It follows directly from the value of the expectations and Markov's 
inequality that for any e > 0, there exists < r\ < 1 such that 

Pi{m p e [^/T 1 ]} > 1 - e • 

This implies that the sequence of random variables (m p ) is tight. Moreover, proceeding as 
above, 

Eim7 u 2 < , , 1 r^ E lt i ( e- 2 v^) hW+mM** \b s ) < ^ uniform i y in p . 

{fi{B s )y v / 

Therefore there exists a subsequence of p's such that m p — >■ m in law and _E;m~ 1 — > Eiin^ 1 = 
1 by (14. 8p and by the uniform boundedness of the above moment. It remains to show that 
Eim = 1 and that the variance of m is non-zero so that m fluctuates. Integrating over Ei 
one has the identity 

Etm 2 p = ^ 2 (e T ^ v - v '^ . 

To prove both claims, it suffices to show that the limit of -E/m 2 along the subsequence is 
finite (ensuring the limit of Eim p is Eim) and strictly greater than one (ensuring the variance 
is non-zero). This will be true if we choose the integers T(p) such that T(p)r^f ax — > log^. 
(Note that T(p)5 2p — > for any 5 < r max for this choice.) In this case, the following hold 



El ml =^ 2 (e T ^^ P ) > ae T ^- 2 > 1 
E x m\ =^ 2 (e 



/i/Ol.'-'i'-^ < e T(p)r^ x _^ 2 < ^ 



leading to the contradiction. □ 

We remark that stochastic stability alone is not sufficient to imply that the sampling 
measure of a ROSt be supported on a sphere. This is demonstrated by the following example. 
Take p = (pi)i^n a Poisson-Dirichlet variable with parameter xi, and p' = (Pj)jeN a Poisson- 
Dirichlet variable with parameter X2 ^ x\. Pick q\ ^ q 2 strictly positive such that qi + q 2 = 1 
and 

(1 - xx)q x = (1 - x 2 )q 2 . (4.9) 

It suffices to consider the ROSt with sampling measure /i = J2iPi + TljP'j ^ where 
(ui) are orthogonal vectors of norm ^fq\ and (vj) are orthogonal vectors with norm ^fq^ also 
orthogonal to the u's. A Poisson-Dirichlet variable with parameter x has the property that, 
for any positive random variable W such that EW X < oo and for a iid sequence (W») with 
the law of W (see e.g. j5]), 

( Pi Wi) *= w (E\W*\ 1/x Pi) ■ 
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Therefore taking Wi = e l ^ Ui ' and Wj = e l<yVj \ we have for the variables defined above and for 
the cavity field I: 

/ 7ft,.-)_£Ls law -a-^i)gi , . j / / if«o-3a.\ law -( 1 ~ a; 2)g2 , M 
(pje H w 2 ) = e 2 (pj ) and (p^e H jj 2 ) = e 2 Qr/.) . 

The relation ( 14. 9 p ensures that the constant is the same in both cases, hence vanishes after 
normalization of the weights. This shows that the constructed /1 is stochastically stable 

The above setup also provides a counterexample to the Ultrametricity Conjecture [I] if 
stochastic stability for a single cavity field alone holds. This is demonstrated by the following 
example coming from the limit of two uncoupled REM's as studied in [8j. It suffices to 
consider the ROSt with sampling measure /i = YlijPiP'j ^-(ih+vj-)' ^ * s eas ily checked that 
this ROSt is stochastically stable from the invariance property of Poisson-Dirichlet variables 
and the fact that l(-^(ui + Vj)) = -^l{ui) + -^K v j) (the restriction ( 14. 9 p is not needed here). 
On the other hand, the support of its sampling measure is not ultrametric as it can be easily 
checked from the following triplet of vectors in the support of /i: 775 («i + t>i), ^75(^2 + ^2) 
and ^75 («i + v 2 ). 
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